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THE EXPECTED JAGGEDNESS OF ORDER IDEALS 


MELODY CHAN, SHAHRZAD HADDADAN, SAM HOPKINS, AND LUCA MOCI 

Abstract. The jaggedness of an order ideal 7 in a poset P is the number of maximal 
elements in I plus the number of minimal elements of P not in I. A probability 
distribution on the set of order ideals of P is toggle-symmetric if for every p £ P, the 
probability that p is maximal in I equals the probability that p is minimal not in I. 
In this paper, we prove a formula for the expected jaggedness of an order ideal of 
P under any toggle-symmetric probability distribution when P is the poset of boxes 
in a skew Young diagram. Our result extends the main combinatorial theorem of 
Chan-Lopez-Pflueger-Teixidor [4], who used an expected jaggedness computation as 
a key ingredient to prove an algebro-geometric formula; and it has applications to 
homomesies, in the sense of Propp-Roby, of the antichain cardinality statistic for 
order ideals in partially ordered sets. 


1. Introduction 

Consider an a x 6 grid, and consider the set of lattice paths from the lower-left 
corner of this grid to the upper-right corner. Define a probability distribution on this set 
as follows: a path occurs with probability proportional to the number of a x 6 standard 
Young tableaux with which it is compatible. (We say a path s is compatible with a 
tableau T if all the labels of T northwest of s are smaller than all of the labels of T 
southeast of s. We use English notation throughout.) We will call this distribution /rpn, 
the linear distribution on lattice paths, since it comes from linear orderings of the ab 
boxes in the grid. For example, the six lattice paths in a 2 x 2 grid occur in with 
the probabilities shown below: 


1/5 1/5 1/10 1/10 1/5 1/5 

We may ask: what is the expected jaggedness of a lattice path, chosen according to TRin? 
That is, what is the expected number of turns of such a lattice path? The answer is 
surprisingly simple. 

Theorem 1.1. The expected jaggedness of a lattiee path in an a xb grid, chosen under 
the distribution is exactly 2ab/{a-\-b), the harmonic mean of a and b. 

Theorem o and a generalization thereof appeared recently in [1] as the key combi¬ 
natorial result underlying the computation of the genera of Brill-Noether eurves (Brill- 
Noether loci of dimension 1). Briefly: it is used to compute the average vertex degree 
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in the dual graph of a nodal degeneration, parametrizing Eisenbud-Harris limit linear 
series, of a given Brill-Noether curve. Noted in [1] is the unexpected appearance of the 
harmonic mean, as well as the observation that if the distribution /xun is replaced by 
the uniform distribution, the answer is still the harmonic mean. 

The purpose of this paper is to give a vast generalization of Theorem ll.il in particular 
explaining the seeming coincidence above, and putting it in its proper combinatorial 
context; order ideals in arbitrary posets, and toggle-symmetric probability distributions 
on them. This last is a class of probability distributions that we would like to put forth 
as an interesting property to study, especially in relation to the developing area of 
dynamical algebraic combinatorics. We define toggle-symmetric distributions on order 
ideals of posets, and give, with proof, many natural examples, in Section [2l The word 
“toggle” refers to the procedure of adding or removing an element from a set if it 
is permissible to do so. The term was coined by Striker-Williams m in describing 
Cameron and Fon-Der-Flaass’ involutions on sets of order ideals of posets [3]. Indeed, 
our results have direct applications to homomesy results for order ideals under special 
compositions of toggles, as we will discuss. 

In Section[3l we prove our main result; a formula for expected jaggedness that applies 
to all skew Young diagrams, not just rectangles, and any toggle-symmetric distribution. 
Here is our main theorem; 

Theorem 1.2. Let a be a connected skew shape with height a and width b. Let p, be 
any toggle-symmetric probability distribution on the subshapes of a. Then the expected 
jaggedness of a subshape of a with respect to p is 

(1.1) ^(l+ i(c)P,(c)). 

\ cGC((t) / 

Here; 

• C{a) is the set of outward corners of u, and P;i(c) is the probability (according 
to p) that the edges of the outward corner c are both included in the lattice 
path that “cuts out” the subshape (see Definition 13.21 for details); 

• the displacement 5(c) is proportional to the signed distance between the corner c 
and the antidiagonal of the partition (Definition 13.3p . 

For now, the main point is that the expected jaggedness can be calculated as the 
harmonic mean of a and b, plus a sum of correction terms that can be completely 
understood in terms of p and a. (When fi is a rectangle, there are no correction terms 
and (11.11) gives the harmonic mean exactly, for any toggle-symmetric distribution.) 

There are several key differences between Theorem 11.21 and the corresponding re¬ 
sult [U Theorem 2.8] of Chan et al. First, our theorem applies to any toggle-symmetric 
distribution. Moreover, it is fully symmetric with respect to interchanging rows and 
columns, which is not the case in [1]. Indeed, our result makes explicit that the only 
dependence is on the outer corners and their displacements. This will allow us to im¬ 
mediately derive that for any balanced shape, the expected jaggedness is always the 
harmonic mean; see Corollary 13.81 
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We also note that our results, combined with theorems of Striker have direct 
applications to homomesy results under the operations of rowmotion and gyration on 
posets. In particular, they allow us to recover and generalize a theorem of Propp 
and Roby [8] on homomesies for antichain cardinalities. We explain these applications 
in 113.2I In Section 01 we give four open questions we would like to see explored. 

We close this section by giving an example that illustrates Theorem 11.21 

Example 1.3. Consider the Young diagram shape a = (3,1). The seven subshapes 
of a, equivalently the lattice paths in a, are depicted below. The numbers below 
each path indicate that subshape’s jaggedness, along with the probability of that sub¬ 
shape’s occurrence according to the linear distribution. Then we can calculate directly 
that E^j.^(jag) = 34/15. 


(1; 1/5) (2; 1/15) (3; 2/15) (3; 1/5) (2; 1/15) (3; 2/15) (2; 1/5) 

Now, let us use Theorem o instead to compute E^j.^(jag), using the fact that is 

toggle-symmetric by Proposition 12.91 and Remark 12.Ill The corner c occurring at (1,1) 
is the only outward corner of a. Its displacement 5{c) is —1/6, as in Definition 13.31 
Finally, we have P^jj^(c) = 1/3, by the formula (13.7p obtained in T3.11 Plugging these 
values into (HTD yields 

E(jag) = (12/5) (1 - 1/6 • 1/3) = 34/15, 

as expected. 

Acknowledgments. This paper grew out of discussions at the 2015 conference on Dy¬ 
namical Algebraic Combinatorics at the American Institute of Mathematics (AIM). We 
thank the organizers of the conference, J. Propp, T. Roby, J. Striker, and N. Williams, 
as well as all of the staff at AIM, for providing a very stimulating environment for 
collaboration. We acknowledge SageMathCloud for providing a useful platform for re¬ 
mote collaboration. Finally, we thank R. Stanley for pointing out the use of the Reci¬ 
procity Theorem for order polynomials to compute the number of increasing tableaux 
of bounded height, as detailed in Section [3Tl M. Chan was supported by NSF DMS- 
1204278. S. Hopkins was supported by NSF grant #1122374. 

2. Toggle-symmetric distributions 

For background on posets see [101 §3]. Fix a finite poset {P, <). An order ideal of P 
is a subset I P P such that for every p ^ I and every q ^ P with q < p, we have q P I. 
We denote the set of order ideals of P by 77(P). If P = Pi U P 2 then the set of order 
ideals decomposes as 77(P) = J{Pi) x J{P 2 ) so we will assume from now on that P is 
connected. We do not consider the empty poset connected. Let I P J (P) and let p € P 
be any element. We say p can be toggled in to / if p is a minimal element not in /, 
and that p can be toggled out of I if p is a maximal element in I. Equivalently, p can 
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be toggled in to / if p ^ I and I U {p} G J{P), and p can be toggled out of / if p G I 
and /\{p} G J{P). 

Definition 2.1. The jaggedness of an order ideal I G J{P), denoted jag(/), is the 
total number of elements p & P which can be toggled into I or out of /. 


In this paper we will consider jT(P) as a discrete probability space and so will refer 
to functions on jT(P) as random variables. Define, for each p & P, two indicator ran¬ 
dom variables ,T~ : J{P) —>■ K that record whether p is toggleable-in (respectively 
toggleable-out) of an order ideal. Explicitly, for I G J{P), we define 


V(/) := 


Tiil) := 



if p can be toggled in to /, 
otherwise ’ 

if p can be toggled out of /, 
otherwise. 


These random variables are highly related to Striker’s toggleability m Definition 6.1]. 
Indeed, her toggleability statistic Tp simply decomposes as Tp = Tp^ — Tp~ ■ Note 
furthermore that jag = Ylpepi^p^ + 'Pp~)- this paper, we will show how certain 
conditions on Tp imply conditions on jag, as in the following main definition of the 
section. 


Definition 2.2. Let ^ be a probability distribution on J{P). Given an element p & P, 
we say that p is toggle-symmetric at p if 

P^(p can be toggled in to /) = P^(p can be toggled out of I). 

Equivalently, p is toggle-symmetric at p if 

^^l{Pp) = '^ni'Pp) ~ '^pi'Pp ) = 0 - 

We say that p is toggle-symmetric if it is toggle-symmetric at every p & P. 

We would like to introduce toggle-symmetric probability distributions as an interest¬ 
ing class of distributions on order ideals of posets. We now give plenty of good examples 
of toggle-symmetric distributions. Throughout, we fix a poset P with n := j^P. 


2.1. Toggle-symmetric distributions arising from P-partitions. In this subsec¬ 
tion we define several families of toggle-symmetric distributions that arise from P- 
partitions and related objects like linear extensions. For background on P-partitions 
see [ini §3.15] or the recent historical survey [5]. 

Definition 2.3. A linear extension of P is a bijection i: P ^ {1,2, ...,n} such 
that p < q for p,q € P implies i{p) < i{q). The linear distribution pn^^ on c7(P) 
is defined as follows: for I G T{P) we define pimil) to be the probability that, choos¬ 
ing a linear extension f of P and k G {0,1, 2,... , n} uniformly at random, the order 
ideal £“^({1,..., k}) is equal to /. 
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Definition 2.4. A weak reverse P-partition of height m is a map £: P —)• {0,1,... , m} 
such that p < q for p,q G P implies i{p) < £{q). Fix m > 1. The weak distribution pirn,< 
on J{P) is defined as follows: for I G J{P) we define to be the probability 

that, choosing a weak reverse P-partition i of height m and k G {1, 2,... , m} uniformly 
at random, the order ideal £“^({0 ,... ,k — 1}) is equal to I. 

Remark 2.5. There is a bijection between J{P) and the set of weak reverse P- 
partitions of height 1 given by sending an order ideal I to 1 — 1/ where lx is the 
indicator function of a subset X C P. Thus is simply the uniform distribution 
on J^{P), which we will denote 

Definition 2.6. A strict reverse P-partition of height m is a map P ^ {0,1,... , m} 
such that p<q for p^qGP implies £{p) < i{q). The rank of P, denoted rk(P), is 
the maximum length of a chain of P. Given m > rk(P), the strict distribution p.m,< 
on J{P) is defined as follows: for I G J{P) we define firn,<{I) to be the probability 
that, choosing a strict reverse P-partition £ of height m and k G {0,1,..., m -|- 1} 
uniformly at random, the order ideal £“^({0 ,... ,k — 1}) is equal to I. 

Remark 2.7. We say that P is ranked if there exists a rank function rk: P ^ Z>o 
such that rk(( 7 ) = rk(p) -|- 1 whenever q covers p (denoted p < q) in P. We will always 
assume that 0 is in the image of the rank function in which case rk is uniquely de¬ 
termined if it exists. We say that P is graded if it is ranked and moreover rk(p) = 0 
for all minimal elements p of P and rk(g) = rk(P) for all maximal elements q of P. 
Equivalently, P is graded if all maximal chains of P have the same length. When P is 
graded, the distribution /Ui.k(p),< is easy to describe: it is uniform on the set of all order 
ideals rk“^({0 ,... ,k — 1}) for /c G {0,... ,rk(P) -|- 1}. fn this case we call fJ-rk{P),< the 
rank distribution and denote it by ^rk- 

Now we will show that all of the above distributions Him, and Hm,< are toggle- 

symmetric. We start by proving toggle-symmetry for and Hm,<- 

Lemma 2.8. For any poset P and any m > 1, the distribution Hm,< on J{P) is 
toggle-symmetric. Similarly, for any m > rk(P), the distribution Hm,< on J{P) is 
toggle-symmetric. In particular, the uniform distribution Humi is toggle-symmetric and, 
if P is graded, the rank distribution Hrk is toggle-symmetric. 

Proof. Let us start by proving the lemma with the weak distribution Hm,<- For a 
given p G P, we will define an involution Tp on the set of weak reverse P-partitions of 
height m, and this involution will verify that p, is toggle-symmetric at p. Let P denote 
the poset obtained from P by adjoining a minimal element 0 and a maximal element 1. 
Let £ be a weak reverse P-partition of height m; we extend £ to P by setting .^(0) := 0 
and i{l) := m. Then for p,q G P we define 


max{.^(r ): r <p,r G P} -\- min{.^(r ): p <r,r G P} — £{p) 


Q^P, 
q = p. 


(2.1) Tp{i){q):- 
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Evidently Tp is an involution and preserves the relevant weak inequalities. For i a weak 
reverse P-partition of height m and /c € {1, 2,, m} we have 


Tp^ir\{o,...,k-i})) 


1 if max{£(r): r <p,r € P} < k < £{p), 
0 otherwise. 


Thus 

(7/) = ^(Kp) - max{£(r) : r <p,r G P}) 
for i a uniformly random weak reverse P-partition of height m. Similarly, 

= IE(min{£(r): p < r,r € P} - i{p)). 

But then observe that 

O'p ) = IE(^(p) - max{£(r): r < p, r G P}) 

= E(min{.^(r): p < r, r G P} — Tp{i){p)) 

~ i'^p ) 

and thus indeed Prn,< is toggle symmetric. 

The proof of the lemma for the strong distribution is exactly analogous to the weak 
distribution. Let ^ be a strict reverse P-partitions of height m; we extend to P by 
setting £(0) := — 1 and £(1) := m + 1. For p G P we define an involution Tp on the set 
of strict reverse P-partitions by the exact same formula (12.Ih as above. This involution 
again establishes that ^ [Tp) = 0. The last sentence follows from Remarks 12.51 
and 12.71 □ 


Proposition 2.9. ITe have 

lim Prn,< = lim Prn,< = Win- 
m—^oo ~ m—^oo 

Proof. To prove this proposition we will define an intermediary distribution 
on 77(P) based on injective order-preserving maps. It will turn out that = fiiin- 

For m > n — 1 and I G T[P) we define to be the probability that, choos¬ 

ing an injective order-preserving map i: P ^ {0,1,, m} and k G {0,1,..., m -|- 1} 
uniformly at random, the order ideal i~^[{0,... ,k — 1}) is equal to /. First we claim 

lim Prn,< = lim prn,< = hm Pm,^- 
m^oo ~ m—>-(X) m—>-oo 

This is clear because as m —>■ oo the fraction of (weak or strict) order-preserving 
maps P —>■ {0,1,...,m} that are injective approaches 1. Furthermore, in the case 
of as m —>■ oo the probability that a uniformly chosen /c G {0,..., m-t-1} actually 

lands in {1,..., m} approaches 1. 

Next we claim that = Pim for all m > n — 1. Given an order ideal I, let L[I) 

denote the set of linear extensions i: P n} that are compatible with /; 

that is, if p G / and q ^ I then i{p) < £[q). Let $n,m denote the set of order¬ 
preserving injective maps 4>-. {0,...,n-|-1} —> {—1,...,m-|-1} such that (j)[0) = —1 
and (l)[n -|- 1) = m -|- 1- Then 
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(0(#/+l)-0(#/)), 

££L{I) 

where the sign ~ denotes proportionality up to a constant. The reason is that the 
order-preserving injective map gives rise to I if and only if I is compatible 

with i, and furthermore, if I is compatible with the linear extension i, then I arises 
from the map o ^ with probability proportional to 

But now we claim the inner sum “ </’(#-^)) is a constant, not 

depending on Indeed, given cj) G ^n,m, call the signature of cj) the multiset of 
consecutive differences 

{</>(!)-<?i(0), (/>(2)-(/>(!),... , (^{n+l)-4>{n)}. 

Then the sum (</>(#/+!) —restricted to any given signature-equivalence 
class in ^n,m is a constant, not depending on #/. Therefore, the same is true for 
the sum over all (p G This shows that is proportional to ipL{I) and 

so Urn,^ — /Jlin- D 

From Lemma 12.81 and Proposition 12.91 we conclude: 

Corollary 2.10. The linear distribution //un on J{P) is toggle-symmetric. 

So for any poset P we have the following “spectrum” of toggle-symmetric distributions: 

/^unif ^ him hvk 

where the rightmost distribution /ij-k applies only to graded P. 

Remark 2.11. Actually, we can give a much more direct and satisfying proof of 
Corollary 12.101 which goes by way of defining some interesting involutions ap for p ^ P 
on the set of linear extensions of P. Note that Corollary 12.101 was proved for skew 
shapes in [4l Lemma 2.9], using involutions on pairs (linear extension, order ideal). 
Instead, the involutions Up that we use here can be regarded as “shuffle” operations 
on the set of linear extensions only, in the spirit of [2]. They are defined as follows. 
Let £ be a linear extension of P. Extend £ to P by setting £(0) := 0 and l{\) '■= n-\-\. 
Let p (z P and x := i{p) and x' := max{l’(r): r <p, r G P}-|-min{£(r): p<.r,r G P} — x. 
Then for q ^ P, define 

x' if £{q) = X, 

l{q) — 1 if X < £{q) < x', 

£{q) -1-1 if x' < £{q) < x, 

£{q) otherwise. 

It is straightforward to verify that ap is indeed an involution on the set of linear 
extensions of P, and that, exactly analogously to the proof of Lemma[221 this involution 
verifies that Epj.^(7),) = 0. 
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2.2. Toggle-symmetric distributions arising from the toggle group. The toggle 
group was introduced by Cameron and Fon-der-Flaass [3] in order to study a certain 
combinatorial map on order ideals that is now called rowmotion. For background on 
the toggle group, rowmotion, and gyration, see [12]. For p G P we define the toggle 
at p, denoted r^: J^{P) J{P)i by 

if/A{p}€ J(P), 

^ 1 / otherwise 

where A denotes the symmetric difference. These are the same Tp as defined in the 
proof of Lemma 12.81 for the weak distribution when m = 1 via the bijection mentioned 
in Remark 12.51 The toggle group is the subgroup of the permutation group 6 gen¬ 
erated by all toggles Tp for p £ P. Recently Striker m proved that certain distributions 
on J' (P) arising from toggle group elements are toggle-symmetric. 

Definition 2.12. Rowmotion is the element of the toggle group 

r£-i(i) o T£-i( 2 ) • • ■ o 

where i is any linear extension of P. Note that because Tp and Tq commute unless p<q 
oi q <p this composition indeed gives a well-defined map. 

Definition 2.13. Assume P is ranked. Gyration is the element of the toggle group 

Toi o ro 2 o • • • O To„^ O Tei o Tej o • • • O 

with {ei,..., Cnq} = {p G P: rk(p) is even} and {oi,..., 0^} = {p G P: rk(p) is odd}. 
Again, because most toggles commute, this composition gives a well-defined map. 

Theorem 2.14 (Striker |11|). Let P be a poset and let <p: LI{P) Gf{P) be rowmotion 
or, in the case where P is ranked, gyration. Then the distribution p that is supported 
uniformly on a fixed ip-orbit O is toggle-symmetric. 

Actually, Striker phrased her result in the language of homomesy. Homomesy is 
a certain phenomenon in dynamical algebraic combinatorics, recently introduced by 
Propp and Roby [8], concerning statistical averages along orbits of combinatorial maps. 

Definition 2.15. Let <S be a set of combinatorial objects and p: 5 —>■ 5 an invertible 
map. We say that the statistic / : 5 —M is c-mesic with respect to the action of p 
on S if there is c G M such that Ylseo /(®) ~ ^ each p-orbit O. In other words, 
we say / is homomesic with respect to p if the average of / is the same for each p-orbit. 

What Striker proved was that, for any poset P and any p G P, the signed toggleability 
statistic Pp is 0-mesic with respect to rowmotion m Lemma 6.2]) and is also 0-mesic 
with respect to gyration when P is ranked m Theorem 6.7]). Clearly these results 
are equivalent to Theorem 12.141 as stated above. 

3. The expected jaggedness in skew shapes 

In this section, we prove a general result giving a formula for the expected jaggedness 
of an order ideal in a poset P for any toggle-symmetric distribution whenever P is the 
poset corresponding to a skew Young diagram. 
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A partition A = (Ai > ... > Xk) is a sequence of weakly decreasing positive integers. 
Recall that associated to A is a Young diagram consisting of A* boxes in the row, 
left-justified. Given two partitions A and n of the numbers i and n respectively, we say 
that p C A if Pj < Aj for all i. We use the usual convention that Aj = 0 if i is greater 
than the number of parts of A. We use English notation when drawing partitions, so 
for instance the Young diagram corresponding to the partition A = (4, 3) is 


Definition 3.1. Let C A be two partitions. The diagram obtained by subtracting 
the Young diagram of n from the Young diagram of A is called a skew Young diagram 
or skew shape. We will write a = Xjv for this shape. 

Let (T = A/p be a skew shape. Throughout, we let a denote the height of cr, i.e., the 
number of rows in cj, and let b denote the width of cr, i.e., the number of columns. In 
order to refer to the boxes of cr and their corners, we will fix coordinates as follows. 
Place cr in an a X 6 rectangle. Our convention will be that the northwest corner of 
the rectangle is (0,0) and the southeast corner is {a,b). The corners of the boxes 
of cr are then various lattice points in this rectangle. Furthermore, we will extend this 
coordinate system to the boxes of cr by writing [i,j] for the box whose southeast corner 
is (i, j). For example, the upper-leftmost box of a Young diagram is the box [1,1]. 

Associated to any skew shape cr is a poset whose elements are the boxes of a 
and with [i,j] < \k,l] if and only i < k and j < 1. Note that is always ranked 
(where the rank function rk([z, j]) = i + j — k, for an appropriate constant k, records 
the diagonal) but is not always graded. All of the general poset-theoretic constructions 
from Section O have more common names when specialized to skew shapes, which we 
record in the following dictionary: 


Poset Pa 

Skew shape a 

Order ideals 

Subshapes 

Linear extensions 

Standard Young tableaux 

Weak reverse P^-partitions 

Reverse plane partitions 

Strict reverse Po-partitions 

Increasing tableaux 


We will not go through all of these terms in detail, but let us comment for a moment 
on subshapes. If cr = A/p is a skew shape, then a subshape o/ cr is a skew shape pjv 
where p is a partition satisfying n C p C X. These are clearly the same as order ideals 
of Pa and so we use the notation J{a) for the set of subshapes of cr. We also often 
identify a subshape p/p G with its lattice path, which is the sequence of steps of 

the form (—1, 0) and (0,1) connecting the point (a, 0) to (0, b) (in the coordinate system 
defined above) given by the southeast border of p. In this way jL(cr) is in bijection with 
the set of lattice paths connecting (a, 0) to (0, h) that stay within the diagram of cr. 
For an example of this bijection see Figure [H 

Definition 3.2. Let cr be a skew shape. We say cr is connected if the poset Pa is 
connected. Suppose a is connected. Then an outward corner of a is two consecutive 
steps along the boundary of cr that do not belong to the same line and do not border a 
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Figure 1. With a = (3,3,1)/(1), we depict (2,1,1)/(1) G shaded 
in yellow and its associated lattice path in red. 



Figure 2. A diagram explaining our notation for corners. Box [3,4] 
of a is shaded yellow and the points where corners c G C{a) occur are 
marked with a circle; the points where c G 6*34(fi) occur are open circles. 


common box of a. We say that a corner occurs at the lattice point (i,j) where its two 
steps meet. We write C{a) for the set of outward corners of a. 

Note that because a is a skew shape, the outward corners of a are either northwest 
corners or southeast corners, i.e., they comprise part of the northwest border of a or 
the southeast border, respectively. 

The following notation will be convenient for us: given a box [i,j] G a, we dehne 

Cij{a) = {corners c G C{a) occurring strictly northwest or strictly southeast of [i,i]}. 

When we say that a corner c occurs “strictly northwest” or “strictly southeast” of a 
box [i,j], we mean that it occurs strictly northwest (respectively strictly southeast) of 
the center of that box. For example, a corner at the point (i, j) occurs strictly southeast 
of the box [i,j]. Figure [2] illustrates our notation for corners. 

For c G C{a) and ^ a probability distribution on J{(t) we use the notation P^(c) to 
mean the probability with respect to /r that a subshape of a, thought of as a lattice path, 
includes the two steps of the corner c. It is important to note that if the corner c G C* (cr) 
occurs at {i,j), then saying that the lattice path p G J{c) includes c is a stronger 
statement than merely saying that p passes through (i,j). 


Definition 3.3. Let u be a connected skew shape with height a and width b. The 
main anti-diagonal of a is the line joining (a, 0) to (0,5). For {i,j) G let d{i,j) 
denote the vector from (i, j) to the main anti-diagonal of a (and orthogonal to it). For 
an outward corner c G C{a) that occurs at {i,j) we define the displacement of c to be 


(5(c) 


the unique x G M with d(0,0) = x ■ d{i,j) if c is a northwest corner, 
the unique x G M with d{a,b) = x ■ d{i,j) if c is a southeast corner. 
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Figure 3. An example of a “rook” at the box [3,2], 


Note that 5(c) is a signed quantity. Explicitly, 

,,,, (l — X — X if c is a northwest corner, 

5(c) = ’ 

[—1 + ^ + 1 if c is a southeast corner. 

Now we can state main theorem of our paper, which computes the expected jagged¬ 
ness of a subshape of a for any toggle-symmetric distribution as the harmonic mean of 
its height and width, up to a sum of signed correction terms. 


Theorem 3.4. Let a he a connected skew shape with height a and width h. Let p, he 
any toggle-symmetric prohahility distribution on J{a'). Then the expected jaggedness of 
a suhshape of a with respect to the distribution p is 

(3-1) IE^(jag) = 1 + X] ) • 

\ cGC((t) / 

In the rest of this section we will prove Theorem 13.41 In order to that, we define a 
set of random variables Rij that we refer to as rooks. The proof of the main theorem 
involves strategically placing rooks on our skew shape a. 

Let [i,j] be a box in a. We write and TjJ for the toggle-indicator random 
variables and on J{Pa) = ^/(cr) defined in Section [2j We define the rook 
random variable Rij: J{(j) —)• M as follows: 

(3.2) Ik,:= Y. Ti’+ E UJ- E Tif- Y Tr 

i'<i,j'<j i'>i,j'>j 

[i'dleo" [*'j']eCT [*',i']Gcr [i',j']Gcr 

The equation dehning Rij is complicated and it is best understood by a drawing as in 
Figure [3l In this figure, we record the coefficients of the terms T-t., and TT, in Ra 
in the northwest and southeast corners, respectively, of the box \i\j']. The reason we 
call Rij a rook is explained by the next lemma, which says that for a toggle-symmetric 
distribution p only the toggleability statistics corresponding to boxes in the same row 
or column as [i,j] contribute to the expectation E,^{Rij). 
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Figure 4. This figure illustrates how each subshape may contribute 
to K{Rij). Here [i, j] = [3, 2] and the points where corners c G Cij occur 
are marked with a circle. Two lattice paths pi,P 2 € J^icr) are drawn in 
blue and red; we can verify that Rij{pk) = 1 + i^Cij{pk) for fe = 1, 2. 


Lemma 3.5. Let a be a skew shape and p, a toggle-symmetric probability distribution 
on J{cr). Then for any [i,j] £ a we have 

E;.{Aj)= E E„(7-+)+ 


Proof. Expanding formula (13.2h . 


^ij Yli'<i, j'<j'Tiiji Yli'>i, j'>j ' i'j' 


"+ _ . . T” 

1' r u 

[i'd'lGcr K'j'letr K'j'lGcr [i'j'lGcr 

Since ;U is a toggle symmetric distribution by linearity of expectation we get 



E 

\ 

- E 

= 0; 


E ' 

E 1 

\ 

i'j' 


\ [*',i']G<7 





[j'.i'lGo- 

/ 


Hence the claimed expression for indeed holds. 


□ 


Lemma 3.6. Let a be a connected skew shape and p a probability distribution on fL{cr). 
Then for any [i,j] £ a we have 

= 1 + P^(c). 

cGCij(cr) 

Proof. Let p £ J{(t). Let Cij{p) be the set of all corners c G Cij{a) included in the 
lattice path p. We observe that Rij{p) = 1 + ffCij{p). This observation is again best 
understood by a picture, as in Figures [3] and 01 In Figure El the set Cij{a) is empty, 
and the claim that Rij{p) = 1 for any lattice path p drawn through the skew shape 
corresponds to the observation that the turns in p always have total weight 1 (with the 
weights as drawn). As usual, we identify lattice paths and subshapes. 
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Figure 5. An example of a rook placement that satisfies Lemma 13.71 
Here a = 4 and 6 = 7; the southeast border strip is shaded in yellow. 


The more general formula Rij{p) = 1 + #Cij{p) then corresponds to the fact that 
any outward corner c G Cij{a) used by p is no longer labeled —1, simply because there 
is no box at c to be toggled in or toggled out. This is illustrated in Figure [H 
But 

C&Cij (cr) 

and hence the claimed expression for ¥,^{Rij) indeed holds. □ 

Lemma 3.7. For any connected skew shape a with height a and width b there exist 
integral coefficients rij G Z for [i,j] G a such that 

• for alll <i<a, = b; 

• for all l<j<b, = o- 

Proof. If we interpret the coefficient rij as the number (possibly negative) of rooks 
placed at box [i,j] G a, the equalities say that each row should be attacked by a 
total of 6 rooks and each column by a total of a rooks. There are many possible such 
placements. Here is one. Let B := {[i, j] G a: [i+l,j+l] ^ a} denote the set of boxes 
in the southeast border strip of a. We claim there is a unique choice of rij satisfying 
the desired equalities with rij = 0 if [i,j] ^ B. Let 6 i, 62 ,... , 6 ^ be the elements of B 
in the unique order so that 61 is southwesternmost, bm is northeasternmost, and bk is 
adjacent to b^+i for all 1 < A: < m. Then for each 1 < k < m, exactly one of the 
following holds: 

(I) 6; is not in the same row as 6^ for all I > k; 

(H) 6; is not in the same column as 6^ for all I > k. 

Thus for k = with bk = [ik,jk], we can choose the corresponding coeffi¬ 
cients rif,j^ in order: when we are in case (I) we choose so that j = 6; 

when we are in case (H) we choose so that Yl[i ~ each row or 

column, there is at least one bk in that row or column, so in the end all the equations 
will be satisfied. The result is an assignment of coefficients that looks like Figure [5j □ 


Proof of Theorem \3.4\ Let rij be the coefficients from Lemma 13.71 Note that the sum 
of all coefficients is jJgo-’’ b ~ [*^/] € ^ sum of coefficients in 
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its row and its column is Yl[i,j]Ga- i^ij + S[j,i]eo- = a + b. Using Lemma [331 we get 


(3.3) E I ^ rijRi 


j=j 


.M - E ’■•i E + E 

\[*'j]G <7 [iJ']Gcr 

\[*'j]Go- [jj'lGcr y 

= (a + 6) E(7;+) 


[*j] Go- 


On the other hand, by Lemma 13.61 


(3.4) 


^ I I — Uj I ^ 

J*d]Gcr y [i,i]G(T \ cgCij(o-) 

= Z + Z ''b' Z 

[i,i]eo- [*,j]Go- ceCij{a) 

( \ 


ab+ Y, 

c€C((t) 


E 


[ 2 ,j]Gcr with 
y Cij{cr) 3 c j 


P/.(c) 


As depicted in Figure^ for any corner c G C{a) occurring at (x, y) and for any [i,j] € cr, 
we have c G Cij(a) if and only if (x > i and y > j) or (x < i and y < j). Let c G C{a) 
be a southeast corner occurring at {x,y). We have 

Z ~ Z “ Z “ Z 


[2,j]Gcrwith [ij]£(7 

Cij{cr)Bc 




= ab — {a — x)b — {b — y)a 

-K^f-)■ 

With similar calculations we can see for any c G C{a) a northeast corner occurring 
at (x,y) we also have Yh [i,j]ea '’"ij = “^(1 “ f “ f )• other words, for c G C{a), 

Cij{cr)Bc 

(3.5) rij = ab-5{c). 

[*j]Go- 

ceCij(cr) 

Putting equations (j3.3jl . (j3.4[) and (j3.5h together yields 


+ 6) ^ E(7;+(cT))=a6 1+ ^ 5(c)P(c 


[*j]Gc 


CgC((T) 
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Figure 6. In the above diagram, let Xi be the set of pink boxes and X 2 
the set of dark red boxes. Let ci be the corner occurring at (2,5) (in 
pink) and C 2 the corner at (3,2) (in dark red). Then [i,j] € Xi if and 
only if Cl € Cij{a) and [i,j] € X 2 if and only if C 2 € 



Figure 7. Examples of balanced skew shapes. 

But since fi is a toggle-symmetric measure, E^(jag) = Hence the 

claimed formula for E^(jag) holds. □ 

Let us say a skew shape a is balanced if it is connected and (5(c) =0 for all c € C{a). 
In other words, a connected skew shape is balanced if all outward corners occur at the 
main anti-diagonal. An immediate corollary of our main theorem is the following: 

Corollary 3.8. Let a be a balanced skew shape with height a and width b. Let p, be 
any toggle-symmetric probability distribution on J ((t) . Then the expected jaggedness of 
a subshape in J ((t) with respect to the distribution p is . 

Some examples of balanced skew shapes are depicted in Figure 0 They include 
rectangles like (A), staircases like (B), “stretched” staircases (i.e., staircases where we 
have replaced each box hy a k x I rectangle) like (C), as well as other more general 
shapes like (D). There are a total of balanced skew shapes with height a and 

width h for any a,b > 1. 

Along the same lines, say that a skew shape a is abundant if all of its northwest 
corners occur on or above its antidiagonal and all of its southeast corners occur on 
or below its antidiagonal. Let us say that a is deficient if all of its northwest corners 
occur on or below the antidiagonal and all of its southeast corners occur on or above 
the antidiagonal. Then we immediately get: 

Corollary 3.9. Let a be a skew shape of height a and width b and p be any toggle- 
symmetric probability distribution on J (cj). 
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• If a is abundant, then the expected jaggedness of a subshape in J (cr) with respect 
to the distribution p, is at least 2ab/{a+b). 

• If a is deficient, then the expected jaggedness of a subshape with respect to p is 
at most 2ab/{a+b). 

We remark that in the case where fi is a rectangle and p = p\\a or PunH, Corol¬ 
lary ElSl recovers a result of Chan et al. [1]. Indeed, Remark 2.16 of [3] points out 
the “remarkable” fact that for rectangles, the uniform and linear distributions have 
the same expected jaggedness; Corollary 13.81 is a vast generalization, and perhaps even 
explanation, of this phenomenon. Theorem 13.41 also gives a reformulation of [U Theo¬ 
rem 2.8] (which deals with p\[^ only) which exhibits more explicitly the way in which 
expected jaggedness depends on the shape of a. 


3.1. Computing the correction terms for various toggle-symmetric distribu¬ 
tions. Although Theorem 13.41 gives an especially nice formula for E^(jag) when u is a 
balanced, even when a is not balanced the correction term Y^ceCia) ™ 

formula is easy to compute for all of the “natural” toggle-symmetric distributions de¬ 
fined in Section EH as we now explain. Of course the displacement 5{c) for c G C{a) 
is easily computed; the issue is computing P;i(c). By Remarks 12.51 and 12.71 the distri¬ 
butions Pnnii and are special cases of pm,< and Pm,<, respectively, so from now on 
we discuss computing P^^ <(c), and P;,^_<(c). 

First let us consider p = Pm,<', the other distributions will be similar. Let RPP((t; m) 
denote the set of reverse plane partitions of shape a and height m (recalling the dic¬ 
tionary of terms above). Choose some outward corner c G C{(j) that occurs {i,j)- 
Suppose first that c is a southeast corner. Then 


Mm,< 


(c)=E 


m - max{£([i -h l,j]),t{[i,j + 1])} 


m 


where i G RPP((T;m) is chosen uniformly at random. But 


E(max{£([i -h l,j]),I{[i,j + 1])}) 


m -|- 1 


#RPP(cr U {c}; m) 
#RPP(u;m) 


where a U {c} denotes the skew shape obtained by adding a box at corner c (i.e., for 
this southeast corner, ciU {c} := crU {[i-|- 1, j -|- 1]}). Indeed, this follows from the same 
observation as Lemma 2.10 of [4]: consider the map RPP(cj U {c};m) —>■ RPP((T;m) 
given by forgetting the value at [i + l,j + 1]; for any I G RPP(cr;m) the size of the 
fiber of this map at £ is m -t- 1 — max{£([i -|- l,j]),l{[i,j -|- 1])}. Now suppose that c is 
a northwest corner. Then 


(^m,< 


(c)=E 


/ min{£([i -h l,j]),i{[i,j + 1])} 
y m 


where i G RPP((7; m) is chosen uniformly at random. By the same reasoning as before, 


E(min{£([z l,j]),i{[i,j + 1])}) 


#RPP((T U {c}; m) 
#RPP(f7;m) 
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Whether c is a southeast or northwest corner, we see that 


(3.6) 


#RPP((T U {c}; m) — #RPP(ct; m) 
m ■ #RPP((t; m) 


Similar analysis for the other distributions shows 


(3.7) 


#SYT(a U {c}) 

^ (|ct| + 1) • #SYT(ct) 


where SYT((t) denotes the set of standard Young tableaux of shape a and |(t| is the 
number of boxes in u, and 


(3.8) 


P 


f^m,< 


[c) 


#Inc((T U {c}; m) + ^Inc((T; m) 
(m + 2) • ^Inc((T; m) 


where Inc(cr; m) is the set of increasing tableaux of shape a and height m. 

Thus we have reduced the problem of computing P/^(c) for /i in the spectrum 
of toggle-symmetric distributions on J (u) defined in Section 12.11 to computing the 
quantities #RPP((T;m), ^SYT((t), and #Inc(cr;m). Fortunately there are determi- 
nantal formulas for these. Let a = \/v be a skew shape with A = (Ai,...,Afc) 
and V = (pi,..., z^fc). Then a result of Kreweras [6] says that 


#RPP(f7;m) = det 


/ Aj - Vj -I- m 
\ i — j + m 


Here we interpret (^) = 0 for x < 0. In the special case = 0 the above formula 
was known to MacMahon [71 p. 243]; for more details see [101 Exercise 3.149]. The 
following formula is due to Aitken [I] (although in fact it is a simple consequence of 
the Jacobi-Trudi identity; see [H Corollary 7.16.3]): 


#SYT(u) 


uj! dtt 


1 

{Xi-i- Vj +j)\ 


Here we interpret ^ = 0 if x < 0. In the special case /i = 0 we also have the famous 
Hook-Length Formula, which gives an even better answer for the number of standard 
Young tableaux; namely. 


#SYT(A) 


iAi! n 

[*J]eA 


1 


where h\{i,j) is the hook-length of box [i,j]; see [9l Corollary 7.21.6] for details. As 
for increasing tableaux of bounded height, it follows from the Reciprocity Theorem 
for order polynomials (see m Corollary 3.15.12]) that if H is the unique polynomial 
satisfying H(m) = 7 (tRPP(cr; m) for all m € N then ^Inc(cj;m) = (—1)I'^IH(—m). Thus 
the aforementioned result of Kreweras also allows us to easily compute ^Inc((T;m). 
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3.2. Connections to antichain cardinality homomesy. In this subsection we give 
an application of our main result to the study of homomesies in combinatorial maps. 
Recall the definitions of rowmotion, gyration, and homomesy from Section [2.21 

Let P be a poset. To any I G >J{P) we associate the antichain A(I) of P consisting 
of the maximal elements of I. The antichain cardinality statistic is the map J{P) —>■ M 
given by I i-A #A{I). 

Corollary 3.10. If P is the poset associated to the skew shape a and /r is any toggle- 
symmetric distribution, then 

M*A{i)) = Pf-Ai+ Y. ■ 

V cec(^) / 

Proof. This result was already obtained in the proof of Theorem 13.41 Explicitly, the 
antichain cardinality statistic is just YlpeP^ '^p~ ^ average of this statistic is 

M E V) = E V) + E E)) 

pGPa P&P<J P&Pa 

= ^IE^(jag) 


where 7^ ) = ^uiY^pePa'^iA) thanks to the toggle-symmetry of fi. Now 

apply Theorem 13.41 □ 

Corollary 3.11. For Pq- the poset corresponding to a balanced skew shape a of height a 
and width b and (p G {rowmotion, gyration}, the antichain cardinality statistic is 
mesic with respect to the action of (p on J{Pfj). 

Proof. Let O C J{Pcr) be a (/?-orbit and let p, be the distribution on J{Pa) that 
is uniform on O. By Theorem 12.141 we know that p is toggle-symmetric. Thus by 
Corollaries 13.81 and 13.101 we conclude that K^{ffA{I)) = □ 


In the case where (p = rowmotion and u is an a x 5 rectangle. Corollary 13. Ill recovers 
a result of Propp and Roby [U Theorem 27]. Actually, Propp and Roby prove a more 
refined result: they show the cardinality of the intersection of the antichain with any 
hxed “fiber” of P^ is homomesic with respect to rowmotion in this rectangular case. In 
other words, they show that the statistics j/jgo-for 1 < i < a and j]Gcr 
for 1 < j <b are homomesic with respect to the action of rowmotion on ^{PAj. But 
when fj is an a X 6 rectangle and 1 < z < a we have 


E 




E 

[h-t-lid'lGcr 


rp+ 
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and similarly for columns. Thus by the toggle-symmetry of /r, where /U is as in the 
proof of Corollary 13.111 we conclnde that in this case 



= E„ 


E ' 

J*2,i']Gcr 




for any 1 < ii,i 2 < o, and similarly for colnmns. In this way we can recover Propp 
and Roby’s refined fiber cardinality resnlt as well. This argument also shows that 
fiber cardinality is homomesic for gyration acting on rectangnlar shapes. (Bnt note 
that the fiber cardinality homomesy does not hold for arbitrary balanced shapes.) At 
any rate, for non-rectangnlar, balanced a when y? = rowmotion, and for all balanced a 
when (p = gyration, the antichain cardinality homomesy result of Corollarv l3.11l appears 
to be new. 


4. Open questions 

We conclnde with some open questions and possible threads of future research. 

(1) For any poset P, the space of toggle-symmetric distributions on J{P) is some 

convex polytope. Denote this polytope by V{P). What is the combinatorial 
structure of P{P)7 Note that P{P) has dimension #J{P) — 1 — #P: specifi¬ 
cally, it is the intersection of the standard (P)-simplex in with some 

linear subspace of codimension i^P, and the nniform distribntion on J{P) is 
an interior point of the simplex that is always toggle-symmetric. It seems 
that V{P) can be rather complicated; for example, computation with Sage 
mathematical software shows that when P\ is the poset corresponding to the 
partition A = (3,3,3) the polytope P{P\) is 10-dimensional and has 159 ver¬ 
tices. For a specific qnestion about V{P): are the distributions corresponding 
to (/5-orbits for p G {rowmotion, gyration} always vertices of V{P)7 

(2) Rowmotion and gyration are both elements of the toggle group; moreover, they 
are both compositions of all of the toggles in some order. Not all snch com¬ 
positions of toggles are 0-mesic with respect to Tp for all p £ P] for instance. 
Striker m §6] observes an instance where this fails for promotion, another 
such element of the toggle group. Nevertheless, we could hope that there were 
some other toggle group elements p : J(P) J (P) that are 0-mesic with re¬ 
spect to Tp for all p £ P. It would be interesting to find such p because then 
Corollary 13.81 would immediately imply that the antichain cardinality statistic 
is homomesic with respect to p. 

(3) For a connected skew shape a with height a and width b and any p £ J (a) we 
claim that 

/ s r . . ^ 4ab 

1 < jag(/9) < min{2a, 26, a -|- 6 — 1} < —-j-^. 

To see this, first note that either p is nonempty or cr \ p is nonempty and so 
there is at least one box of a that can be toggled in or ont, proving 1 < jag(/9). 
Next note that in each column, at most one box can be toggled in and at most 
one out, and similarly for rows. This proves jag(/9) < min{2a, 26}. The only 
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case where a + 6 — 1 < min{2a, 2b} is when a = 6; in this case, note that if a 
box can be toggled out of every column, then there is no box in the first column 
that can be toggled in. So indeed the claimed inequality on jag(/9) holds. The 
upshot of this inequality is that for any distribution fi on J{(t), 

0 < E^(jag) < 

a + b 

If // is toggle-symmetric then by Theorem 13.41 we conclude 
-1< ^ 5(c)P^(c)<l. 

ceC(a-) 

It is not obvious a priori that this bound on Ylic^c(a) should hold for 

all toggle-symmetric distributions /i. It would be interesting to give a simple 
explanation for why it does hold, or to offer another expression for E^(jag) that 
is evidently strictly between 0 and 

A related question, pointed out by N. Pflueger, is to give a direct explanation 
for why, for any balanced skew shape a and any toggle-symmetric distribution, 
the expected jaggedness of a subshape necessarily lies between a and b. (This 
is true, of course, since the harmonic mean always lies between a and b.) 

(4) Our main theorem, Theorem 13.41 which gives a formula for E^(jag) for toggle- 
symmetric distributions jj., applies only to posets associated to skew shapes. 
Can we generalize this result to a broader class of posets? In particular, is 
there a more general notion of a “balanced” poset for which all toggle-symmetric 
distributions have the same expected jaggedness? 
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